Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Dataproc: Make internal_ip_only a computed, not defaulted, field. Always send it when specified. #11791

Closed

Conversation

Harwayne
Copy link
Contributor

@Harwayne Harwayne commented Sep 23, 2024

Make internal_ip_only of google_dataproc_cluster a computed, not defaulted, field. Always send it when specified by the user.

The 'default' value for this field is determined on Dataproc's servers, based on the image version used. Users can still provide a value to override the default, but if the user does not provide the value, then the value generated by Dataproc's servers should be used.

This is being done because the server-side default changed between Dataproc image versions < 2.1 and >= 2.2, from true to false respectively.

Fixes hashicorp/terraform-provider-google#19522.

Release Note Template for Downstream PRs (will be copied)

dataproc: Changed `google_dataproc_cluster` `internal_ip_only` field to computed and always sent if specified.

@modular-magician modular-magician added the awaiting-approval Pull requests that need reviewer's approval to run presubmit tests label Sep 23, 2024
@Harwayne Harwayne force-pushed the no-default-internal-ip branch from c2b9571 to 183b0d5 Compare October 2, 2024 17:56
@Harwayne Harwayne changed the title Dataproc: Make internal_ip_only a computed, not defaulted, field. Dataproc: Make internal_ip_only a computed, not defaulted, field. Always send it when specified. Oct 2, 2024
@Harwayne Harwayne marked this pull request as ready for review October 2, 2024 22:44
@github-actions github-actions bot requested a review from melinath October 2, 2024 22:45
Copy link

github-actions bot commented Oct 2, 2024

Hello! I am a robot. Tests will require approval from a repository maintainer to run.

@melinath, a repository maintainer, has been assigned to review your changes. If you have not received review feedback within 2 business days, please leave a comment on this PR asking them to take a look.

You can help make sure that review is quick by doing a self-review and by running impacted tests locally.

@modular-magician modular-magician added service/dataproc and removed awaiting-approval Pull requests that need reviewer's approval to run presubmit tests labels Oct 2, 2024
@modular-magician
Copy link
Collaborator

Hi there, I'm the Modular magician. I've detected the following information about your changes:

Diff report

Your PR generated some diffs in downstreams - here they are.

google provider: Diff ( 1 file changed, 20 insertions(+), 6 deletions(-))
google-beta provider: Diff ( 1 file changed, 20 insertions(+), 6 deletions(-))

Breaking Change(s) Detected

The following breaking change(s) were detected within your pull request.

  • Field cluster_config.gce_cluster_config.internal_ip_only default value changed from false to on google_dataproc_cluster - reference

If you believe this detection to be incorrect please raise the concern with your reviewer.
If you intend to make this change you will need to wait for a major release window.
An override-breaking-change label can be added to allow merging.

Missing test report

Your PR includes resource fields which are not covered by any test.

Resource: google_dataproc_cluster (52 total tests)
Please add an acceptance test which includes these fields. The test should include the following:

resource "google_dataproc_cluster" "primary" {
  cluster_config {
    gce_cluster_config {
      internal_ip_only = # value needed
    }
  }
}

@Harwayne Harwayne force-pushed the no-default-internal-ip branch 2 times, most recently from fc08f11 to 3b40590 Compare October 2, 2024 23:02
@modular-magician
Copy link
Collaborator

Tests analytics

Total tests: 62
Passed tests: 20
Skipped tests: 6
Affected tests: 36

Click here to see the affected service packages
  • dataproc

Action taken

Found 36 affected test(s) by replaying old test recordings. Starting RECORDING based on the most recent commit. Click here to see the affected tests
  • TestAccDataprocClusterIamBinding
  • TestAccDataprocClusterIamMember
  • TestAccDataprocClusterIamPolicy
  • TestAccDataprocCluster_KMS
  • TestAccDataprocCluster_nonPreemptibleSecondary
  • TestAccDataprocCluster_singleNodeCluster
  • TestAccDataprocCluster_spotSecondary
  • TestAccDataprocCluster_withAccelerators
  • TestAccDataprocCluster_withAutoscalingPolicy
  • TestAccDataprocCluster_withConfigOverrides
  • TestAccDataprocCluster_withDataprocMetricConfig
  • TestAccDataprocCluster_withEndpointConfig
  • TestAccDataprocCluster_withImageVersion
  • TestAccDataprocCluster_withInitAction
  • TestAccDataprocCluster_withKerberos
  • TestAccDataprocCluster_withLabels
  • TestAccDataprocCluster_withLifecycleConfigIdleDeleteTtl
  • TestAccDataprocCluster_withMetadataAndTags
  • TestAccDataprocCluster_withMinNumInstances
  • TestAccDataprocCluster_withNodeGroupAffinity
  • TestAccDataprocCluster_withOptionalComponents
  • TestAccDataprocCluster_withReservationAffinity
  • TestAccDataprocCluster_withServiceAcc
  • TestAccDataprocCluster_withStagingBucket
  • TestAccDataprocCluster_withTempBucket
  • TestAccDataprocJobIamBinding
  • TestAccDataprocJobIamMember
  • TestAccDataprocJobIamPolicy
  • TestAccDataprocJob_Hadoop
  • TestAccDataprocJob_Hive
  • TestAccDataprocJob_Pig
  • TestAccDataprocJob_Presto
  • TestAccDataprocJob_PySpark
  • TestAccDataprocJob_Spark
  • TestAccDataprocJob_SparkSql
  • TestAccDataprocJob_updatable

Get to know how VCR tests work

@modular-magician modular-magician added the awaiting-approval Pull requests that need reviewer's approval to run presubmit tests label Oct 2, 2024
@melinath melinath requested review from slevenick and removed request for melinath October 2, 2024 23:03
@modular-magician
Copy link
Collaborator

🟢 Tests passed during RECORDING mode:
TestAccDataprocClusterIamBinding[Debug log]
TestAccDataprocClusterIamMember[Debug log]
TestAccDataprocClusterIamPolicy[Debug log]
TestAccDataprocCluster_KMS[Debug log]
TestAccDataprocCluster_nonPreemptibleSecondary[Debug log]
TestAccDataprocCluster_singleNodeCluster[Debug log]
TestAccDataprocCluster_spotSecondary[Debug log]
TestAccDataprocCluster_withAutoscalingPolicy[Debug log]
TestAccDataprocCluster_withConfigOverrides[Debug log]
TestAccDataprocCluster_withDataprocMetricConfig[Debug log]
TestAccDataprocCluster_withEndpointConfig[Debug log]
TestAccDataprocCluster_withImageVersion[Debug log]
TestAccDataprocCluster_withKerberos[Debug log]
TestAccDataprocCluster_withLabels[Debug log]
TestAccDataprocCluster_withLifecycleConfigIdleDeleteTtl[Debug log]
TestAccDataprocCluster_withMetadataAndTags[Debug log]
TestAccDataprocCluster_withMinNumInstances[Debug log]
TestAccDataprocCluster_withOptionalComponents[Debug log]
TestAccDataprocCluster_withReservationAffinity[Debug log]
TestAccDataprocCluster_withStagingBucket[Debug log]
TestAccDataprocJobIamBinding[Debug log]
TestAccDataprocJobIamMember[Debug log]
TestAccDataprocJobIamPolicy[Debug log]
TestAccDataprocJob_Hadoop[Debug log]
TestAccDataprocJob_Hive[Debug log]
TestAccDataprocJob_Pig[Debug log]
TestAccDataprocJob_PySpark[Debug log]
TestAccDataprocJob_Spark[Debug log]
TestAccDataprocJob_SparkSql[Debug log]
TestAccDataprocJob_updatable[Debug log]

🟢 No issues found for passed tests after REPLAYING rerun.


🔴 Tests failed during RECORDING mode:
TestAccDataprocCluster_withAccelerators[Error message] [Debug log]
TestAccDataprocCluster_withInitAction[Error message] [Debug log]
TestAccDataprocCluster_withNodeGroupAffinity[Error message] [Debug log]
TestAccDataprocCluster_withServiceAcc[Error message] [Debug log]
TestAccDataprocCluster_withTempBucket[Error message] [Debug log]
TestAccDataprocJob_Presto[Error message] [Debug log]

🔴 Errors occurred during RECORDING mode. Please fix them to complete your PR.

View the build log or the debug log for each test

@Harwayne Harwayne marked this pull request as draft October 2, 2024 23:41
@modular-magician modular-magician removed the awaiting-approval Pull requests that need reviewer's approval to run presubmit tests label Oct 2, 2024
@modular-magician
Copy link
Collaborator

Hi there, I'm the Modular magician. I've detected the following information about your changes:

Diff report

Your PR generated some diffs in downstreams - here they are.

google provider: Diff ( 1 file changed, 7 insertions(+), 1 deletion(-))
google-beta provider: Diff ( 1 file changed, 7 insertions(+), 1 deletion(-))

Breaking Change(s) Detected

The following breaking change(s) were detected within your pull request.

  • Field cluster_config.gce_cluster_config.internal_ip_only default value changed from false to on google_dataproc_cluster - reference

If you believe this detection to be incorrect please raise the concern with your reviewer.
If you intend to make this change you will need to wait for a major release window.
An override-breaking-change label can be added to allow merging.

Missing test report

Your PR includes resource fields which are not covered by any test.

Resource: google_dataproc_cluster (52 total tests)
Please add an acceptance test which includes these fields. The test should include the following:

resource "google_dataproc_cluster" "primary" {
  cluster_config {
    gce_cluster_config {
      internal_ip_only = # value needed
    }
  }
}

@modular-magician
Copy link
Collaborator

Tests analytics

Total tests: 62
Passed tests: 50
Skipped tests: 6
Affected tests: 6

Click here to see the affected service packages
  • dataproc

Action taken

Found 6 affected test(s) by replaying old test recordings. Starting RECORDING based on the most recent commit. Click here to see the affected tests
  • TestAccDataprocCluster_withAccelerators
  • TestAccDataprocCluster_withInitAction
  • TestAccDataprocCluster_withNodeGroupAffinity
  • TestAccDataprocCluster_withServiceAcc
  • TestAccDataprocCluster_withTempBucket
  • TestAccDataprocJob_Presto

Get to know how VCR tests work

@modular-magician
Copy link
Collaborator

🔴 Tests failed during RECORDING mode:
TestAccDataprocCluster_withAccelerators[Error message] [Debug log]
TestAccDataprocCluster_withInitAction[Error message] [Debug log]
TestAccDataprocCluster_withNodeGroupAffinity[Error message] [Debug log]
TestAccDataprocCluster_withServiceAcc[Error message] [Debug log]
TestAccDataprocCluster_withTempBucket[Error message] [Debug log]
TestAccDataprocJob_Presto[Error message] [Debug log]

🔴 Errors occurred during RECORDING mode. Please fix them to complete your PR.

View the build log or the debug log for each test

@Harwayne Harwayne force-pushed the no-default-internal-ip branch from 3b40590 to f438352 Compare October 3, 2024 07:14
@modular-magician modular-magician added awaiting-approval Pull requests that need reviewer's approval to run presubmit tests and removed awaiting-approval Pull requests that need reviewer's approval to run presubmit tests labels Oct 3, 2024
@modular-magician
Copy link
Collaborator

Hi there, I'm the Modular magician. I've detected the following information about your changes:

Diff report

Your PR generated some diffs in downstreams - here they are.

google provider: Diff ( 1 file changed, 46 insertions(+), 1 deletion(-))
google-beta provider: Diff ( 1 file changed, 46 insertions(+), 1 deletion(-))

Breaking Change(s) Detected

The following breaking change(s) were detected within your pull request.

  • Field cluster_config.gce_cluster_config.internal_ip_only default value changed from false to on google_dataproc_cluster - reference

If you believe this detection to be incorrect please raise the concern with your reviewer.
If you intend to make this change you will need to wait for a major release window.
An override-breaking-change label can be added to allow merging.

Missing test report

Your PR includes resource fields which are not covered by any test.

Resource: google_dataproc_cluster (52 total tests)
Please add an acceptance test which includes these fields. The test should include the following:

resource "google_dataproc_cluster" "primary" {
  cluster_config {
    gce_cluster_config {
      internal_ip_only = # value needed
    }
  }
}

@modular-magician
Copy link
Collaborator

Tests analytics

Total tests: 62
Passed tests: 26
Skipped tests: 6
Affected tests: 30

Click here to see the affected service packages
  • dataproc

Action taken

Found 30 affected test(s) by replaying old test recordings. Starting RECORDING based on the most recent commit. Click here to see the affected tests
  • TestAccDataprocClusterIamBinding
  • TestAccDataprocClusterIamMember
  • TestAccDataprocClusterIamPolicy
  • TestAccDataprocCluster_KMS
  • TestAccDataprocCluster_nonPreemptibleSecondary
  • TestAccDataprocCluster_singleNodeCluster
  • TestAccDataprocCluster_spotSecondary
  • TestAccDataprocCluster_withAutoscalingPolicy
  • TestAccDataprocCluster_withConfigOverrides
  • TestAccDataprocCluster_withDataprocMetricConfig
  • TestAccDataprocCluster_withEndpointConfig
  • TestAccDataprocCluster_withImageVersion
  • TestAccDataprocCluster_withKerberos
  • TestAccDataprocCluster_withLabels
  • TestAccDataprocCluster_withLifecycleConfigIdleDeleteTtl
  • TestAccDataprocCluster_withMetadataAndTags
  • TestAccDataprocCluster_withMinNumInstances
  • TestAccDataprocCluster_withOptionalComponents
  • TestAccDataprocCluster_withReservationAffinity
  • TestAccDataprocCluster_withStagingBucket
  • TestAccDataprocJobIamBinding
  • TestAccDataprocJobIamMember
  • TestAccDataprocJobIamPolicy
  • TestAccDataprocJob_Hadoop
  • TestAccDataprocJob_Hive
  • TestAccDataprocJob_Pig
  • TestAccDataprocJob_PySpark
  • TestAccDataprocJob_Spark
  • TestAccDataprocJob_SparkSql
  • TestAccDataprocJob_updatable

Get to know how VCR tests work

@modular-magician
Copy link
Collaborator

🟢 Tests passed during RECORDING mode:
TestAccDataprocCluster_withImageVersion[Debug log]

🟢 No issues found for passed tests after REPLAYING rerun.


🔴 Tests failed during RECORDING mode:
TestAccDataprocClusterIamBinding[Error message] [Debug log]
TestAccDataprocClusterIamMember[Error message] [Debug log]
TestAccDataprocClusterIamPolicy[Error message] [Debug log]
TestAccDataprocCluster_KMS[Error message] [Debug log]
TestAccDataprocCluster_nonPreemptibleSecondary[Error message] [Debug log]
TestAccDataprocCluster_singleNodeCluster[Error message] [Debug log]
TestAccDataprocCluster_spotSecondary[Error message] [Debug log]
TestAccDataprocCluster_withAutoscalingPolicy[Error message] [Debug log]
TestAccDataprocCluster_withConfigOverrides[Error message] [Debug log]
TestAccDataprocCluster_withDataprocMetricConfig[Error message] [Debug log]
TestAccDataprocCluster_withEndpointConfig[Error message] [Debug log]
TestAccDataprocCluster_withKerberos[Error message] [Debug log]
TestAccDataprocCluster_withLabels[Error message] [Debug log]
TestAccDataprocCluster_withLifecycleConfigIdleDeleteTtl[Error message] [Debug log]
TestAccDataprocCluster_withMetadataAndTags[Error message] [Debug log]
TestAccDataprocCluster_withMinNumInstances[Error message] [Debug log]
TestAccDataprocCluster_withOptionalComponents[Error message] [Debug log]
TestAccDataprocCluster_withReservationAffinity[Error message] [Debug log]
TestAccDataprocCluster_withStagingBucket[Error message] [Debug log]
TestAccDataprocJobIamBinding[Error message] [Debug log]
TestAccDataprocJobIamMember[Error message] [Debug log]
TestAccDataprocJobIamPolicy[Error message] [Debug log]
TestAccDataprocJob_Hadoop[Error message] [Debug log]
TestAccDataprocJob_Hive[Error message] [Debug log]
TestAccDataprocJob_Pig[Error message] [Debug log]
TestAccDataprocJob_PySpark[Error message] [Debug log]
TestAccDataprocJob_Spark[Error message] [Debug log]
TestAccDataprocJob_SparkSql[Error message] [Debug log]
TestAccDataprocJob_updatable[Error message] [Debug log]

🔴 Errors occurred during RECORDING mode. Please fix them to complete your PR.

View the build log or the debug log for each test

@Harwayne Harwayne force-pushed the no-default-internal-ip branch from f438352 to d9e36b3 Compare October 4, 2024 18:31
@Harwayne Harwayne marked this pull request as ready for review October 4, 2024 18:32
@modular-magician modular-magician added the awaiting-approval Pull requests that need reviewer's approval to run presubmit tests label Oct 4, 2024
@Harwayne Harwayne force-pushed the no-default-internal-ip branch from 5d42b0e to 29ea815 Compare October 9, 2024 00:21
@modular-magician modular-magician added the awaiting-approval Pull requests that need reviewer's approval to run presubmit tests label Oct 9, 2024
Copy link

@slevenick This PR has been waiting for review for 3 weekdays. Please take a look! Use the label disable-review-reminders to disable these notifications.

@modular-magician modular-magician removed the awaiting-approval Pull requests that need reviewer's approval to run presubmit tests label Oct 10, 2024
@modular-magician
Copy link
Collaborator

Hi there, I'm the Modular magician. I've detected the following information about your changes:

Diff report

Your PR generated some diffs in downstreams - here they are.

google provider: Diff ( 4 files changed, 347 insertions(+), 71 deletions(-))
google-beta provider: Diff ( 4 files changed, 347 insertions(+), 71 deletions(-))

Breaking Change(s) Detected

The following breaking change(s) were detected within your pull request.

  • Field cluster_config.gce_cluster_config.internal_ip_only default value changed from false to on google_dataproc_cluster - reference

If you believe this detection to be incorrect please raise the concern with your reviewer.
If you intend to make this change you will need to wait for a major release window.
An override-breaking-change label can be added to allow merging.

@modular-magician
Copy link
Collaborator

Tests analytics

Total tests: 4152
Passed tests: 3698
Skipped tests: 417
Affected tests: 37

Click here to see the affected service packages

All service packages are affected

Action taken

Found 37 affected test(s) by replaying old test recordings. Starting RECORDING based on the most recent commit. Click here to see the affected tests
  • TestAccDataformRepositoryReleaseConfig_dataformRepositoryReleaseConfigExample
  • TestAccDataformRepositoryWorkflowConfig_dataformRepositoryWorkflowConfigExample
  • TestAccDataformRepository_dataformRepositoryWithCloudsourceRepoAndSshExample
  • TestAccDataformRepository_updated
  • TestAccDataprocClusterIamBinding
  • TestAccDataprocClusterIamMember
  • TestAccDataprocClusterIamPolicy
  • TestAccDataprocCluster_KMS
  • TestAccDataprocCluster_basic
  • TestAccDataprocCluster_nonPreemptibleSecondary
  • TestAccDataprocCluster_singleNodeCluster
  • TestAccDataprocCluster_spotSecondary
  • TestAccDataprocCluster_spotWithAuxiliaryNodeGroups
  • TestAccDataprocCluster_withAccelerators
  • TestAccDataprocCluster_withAutoscalingPolicy
  • TestAccDataprocCluster_withConfigOverrides
  • TestAccDataprocCluster_withDataprocMetricConfig
  • TestAccDataprocCluster_withEndpointConfig
  • TestAccDataprocCluster_withImageVersion
  • TestAccDataprocCluster_withInitAction
  • TestAccDataprocCluster_withInternalIpOnlyTrueAndShieldedConfig
  • TestAccDataprocCluster_withKerberos
  • TestAccDataprocCluster_withLabels
  • TestAccDataprocCluster_withLifecycleConfigIdleDeleteTtl
  • TestAccDataprocCluster_withMetadataAndTags
  • TestAccDataprocCluster_withMetastoreConfig
  • TestAccDataprocCluster_withMinNumInstances
  • TestAccDataprocCluster_withNodeGroupAffinity
  • TestAccDataprocCluster_withOptionalComponents
  • TestAccDataprocCluster_withReservationAffinity
  • TestAccDataprocCluster_withServiceAcc
  • TestAccDataprocCluster_withStagingBucket
  • TestAccDataprocCluster_withTempBucket
  • TestAccDataprocJobIamBinding
  • TestAccDataprocJobIamMember
  • TestAccDataprocJobIamPolicy
  • TestAccDataprocJob_Presto

Get to know how VCR tests work

@modular-magician
Copy link
Collaborator

🟢 Tests passed during RECORDING mode:
TestAccDataprocCluster_basic[Debug log]
TestAccDataprocCluster_withImageVersion[Debug log]
TestAccDataprocCluster_withInternalIpOnlyTrueAndShieldedConfig[Debug log]
TestAccDataprocCluster_withMetastoreConfig[Debug log]

🟢 No issues found for passed tests after REPLAYING rerun.


🔴 Tests failed during RECORDING mode:
TestAccDataformRepositoryReleaseConfig_dataformRepositoryReleaseConfigExample[Error message] [Debug log]
TestAccDataformRepositoryWorkflowConfig_dataformRepositoryWorkflowConfigExample[Error message] [Debug log]
TestAccDataformRepository_dataformRepositoryWithCloudsourceRepoAndSshExample[Error message] [Debug log]
TestAccDataformRepository_updated[Error message] [Debug log]
TestAccDataprocClusterIamBinding[Error message] [Debug log]
TestAccDataprocClusterIamMember[Error message] [Debug log]
TestAccDataprocClusterIamPolicy[Error message] [Debug log]
TestAccDataprocCluster_KMS[Error message] [Debug log]
TestAccDataprocCluster_nonPreemptibleSecondary[Error message] [Debug log]
TestAccDataprocCluster_singleNodeCluster[Error message] [Debug log]
TestAccDataprocCluster_spotSecondary[Error message] [Debug log]
TestAccDataprocCluster_spotWithAuxiliaryNodeGroups[Error message] [Debug log]
TestAccDataprocCluster_withAccelerators[Error message] [Debug log]
TestAccDataprocCluster_withAutoscalingPolicy[Error message] [Debug log]
TestAccDataprocCluster_withConfigOverrides[Error message] [Debug log]
TestAccDataprocCluster_withDataprocMetricConfig[Error message] [Debug log]
TestAccDataprocCluster_withEndpointConfig[Error message] [Debug log]
TestAccDataprocCluster_withInitAction[Error message] [Debug log]
TestAccDataprocCluster_withKerberos[Error message] [Debug log]
TestAccDataprocCluster_withLabels[Error message] [Debug log]
TestAccDataprocCluster_withLifecycleConfigIdleDeleteTtl[Error message] [Debug log]
TestAccDataprocCluster_withMetadataAndTags[Error message] [Debug log]
TestAccDataprocCluster_withMinNumInstances[Error message] [Debug log]
TestAccDataprocCluster_withNodeGroupAffinity[Error message] [Debug log]
TestAccDataprocCluster_withOptionalComponents[Error message] [Debug log]
TestAccDataprocCluster_withReservationAffinity[Error message] [Debug log]
TestAccDataprocCluster_withServiceAcc[Error message] [Debug log]
TestAccDataprocCluster_withStagingBucket[Error message] [Debug log]
TestAccDataprocCluster_withTempBucket[Error message] [Debug log]
TestAccDataprocJobIamBinding[Error message] [Debug log]
TestAccDataprocJobIamMember[Error message] [Debug log]
TestAccDataprocJobIamPolicy[Error message] [Debug log]
TestAccDataprocJob_Presto[Error message] [Debug log]

🔴 Errors occurred during RECORDING mode. Please fix them to complete your PR.

View the build log or the debug log for each test

Copy link
Contributor

@slevenick slevenick left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Dismissing review for now, seems like the clusters are not successfully coming up in many cases

@github-actions github-actions bot requested a review from slevenick October 10, 2024 22:06
@modular-magician modular-magician added awaiting-approval Pull requests that need reviewer's approval to run presubmit tests and removed awaiting-approval Pull requests that need reviewer's approval to run presubmit tests labels Oct 10, 2024
@modular-magician
Copy link
Collaborator

Hi there, I'm the Modular magician. I've detected the following information about your changes:

Diff report

Your PR generated some diffs in downstreams - here they are.

google provider: Diff ( 4 files changed, 347 insertions(+), 71 deletions(-))
google-beta provider: Diff ( 4 files changed, 347 insertions(+), 71 deletions(-))

Breaking Change(s) Detected

The following breaking change(s) were detected within your pull request.

  • Field cluster_config.gce_cluster_config.internal_ip_only default value changed from false to on google_dataproc_cluster - reference

If you believe this detection to be incorrect please raise the concern with your reviewer.
If you intend to make this change you will need to wait for a major release window.
An override-breaking-change label can be added to allow merging.

@modular-magician modular-magician added the awaiting-approval Pull requests that need reviewer's approval to run presubmit tests label Oct 10, 2024
@modular-magician
Copy link
Collaborator

Tests analytics

Total tests: 4152
Passed tests: 3702
Skipped tests: 417
Affected tests: 33

Click here to see the affected service packages

All service packages are affected

Action taken

Found 33 affected test(s) by replaying old test recordings. Starting RECORDING based on the most recent commit. Click here to see the affected tests
  • TestAccDataformRepositoryReleaseConfig_dataformRepositoryReleaseConfigExample
  • TestAccDataformRepositoryWorkflowConfig_dataformRepositoryWorkflowConfigExample
  • TestAccDataformRepository_dataformRepositoryWithCloudsourceRepoAndSshExample
  • TestAccDataformRepository_updated
  • TestAccDataprocClusterIamBinding
  • TestAccDataprocClusterIamMember
  • TestAccDataprocClusterIamPolicy
  • TestAccDataprocCluster_KMS
  • TestAccDataprocCluster_nonPreemptibleSecondary
  • TestAccDataprocCluster_singleNodeCluster
  • TestAccDataprocCluster_spotSecondary
  • TestAccDataprocCluster_spotWithAuxiliaryNodeGroups
  • TestAccDataprocCluster_withAccelerators
  • TestAccDataprocCluster_withAutoscalingPolicy
  • TestAccDataprocCluster_withConfigOverrides
  • TestAccDataprocCluster_withDataprocMetricConfig
  • TestAccDataprocCluster_withEndpointConfig
  • TestAccDataprocCluster_withInitAction
  • TestAccDataprocCluster_withKerberos
  • TestAccDataprocCluster_withLabels
  • TestAccDataprocCluster_withLifecycleConfigIdleDeleteTtl
  • TestAccDataprocCluster_withMetadataAndTags
  • TestAccDataprocCluster_withMinNumInstances
  • TestAccDataprocCluster_withNodeGroupAffinity
  • TestAccDataprocCluster_withOptionalComponents
  • TestAccDataprocCluster_withReservationAffinity
  • TestAccDataprocCluster_withServiceAcc
  • TestAccDataprocCluster_withStagingBucket
  • TestAccDataprocCluster_withTempBucket
  • TestAccDataprocJobIamBinding
  • TestAccDataprocJobIamMember
  • TestAccDataprocJobIamPolicy
  • TestAccDataprocJob_Presto

Get to know how VCR tests work

@modular-magician
Copy link
Collaborator

🔴 Tests failed during RECORDING mode:
TestAccDataformRepositoryReleaseConfig_dataformRepositoryReleaseConfigExample[Error message] [Debug log]
TestAccDataformRepositoryWorkflowConfig_dataformRepositoryWorkflowConfigExample[Error message] [Debug log]
TestAccDataformRepository_dataformRepositoryWithCloudsourceRepoAndSshExample[Error message] [Debug log]
TestAccDataformRepository_updated[Error message] [Debug log]
TestAccDataprocClusterIamBinding[Error message] [Debug log]
TestAccDataprocClusterIamMember[Error message] [Debug log]
TestAccDataprocClusterIamPolicy[Error message] [Debug log]
TestAccDataprocCluster_KMS[Error message] [Debug log]
TestAccDataprocCluster_nonPreemptibleSecondary[Error message] [Debug log]
TestAccDataprocCluster_singleNodeCluster[Error message] [Debug log]
TestAccDataprocCluster_spotSecondary[Error message] [Debug log]
TestAccDataprocCluster_spotWithAuxiliaryNodeGroups[Error message] [Debug log]
TestAccDataprocCluster_withAccelerators[Error message] [Debug log]
TestAccDataprocCluster_withAutoscalingPolicy[Error message] [Debug log]
TestAccDataprocCluster_withConfigOverrides[Error message] [Debug log]
TestAccDataprocCluster_withDataprocMetricConfig[Error message] [Debug log]
TestAccDataprocCluster_withEndpointConfig[Error message] [Debug log]
TestAccDataprocCluster_withInitAction[Error message] [Debug log]
TestAccDataprocCluster_withKerberos[Error message] [Debug log]
TestAccDataprocCluster_withLabels[Error message] [Debug log]
TestAccDataprocCluster_withLifecycleConfigIdleDeleteTtl[Error message] [Debug log]
TestAccDataprocCluster_withMetadataAndTags[Error message] [Debug log]
TestAccDataprocCluster_withMinNumInstances[Error message] [Debug log]
TestAccDataprocCluster_withNodeGroupAffinity[Error message] [Debug log]
TestAccDataprocCluster_withOptionalComponents[Error message] [Debug log]
TestAccDataprocCluster_withReservationAffinity[Error message] [Debug log]
TestAccDataprocCluster_withServiceAcc[Error message] [Debug log]
TestAccDataprocCluster_withStagingBucket[Error message] [Debug log]
TestAccDataprocCluster_withTempBucket[Error message] [Debug log]
TestAccDataprocJobIamBinding[Error message] [Debug log]
TestAccDataprocJobIamMember[Error message] [Debug log]
TestAccDataprocJobIamPolicy[Error message] [Debug log]
TestAccDataprocJob_Presto[Error message] [Debug log]

🔴 Errors occurred during RECORDING mode. Please fix them to complete your PR.

View the build log or the debug log for each test

Copy link

@slevenick This PR has been waiting for review for 3 weekdays. Please take a look! Use the label disable-review-reminders to disable these notifications.

Copy link
Contributor

@slevenick slevenick left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks like tests continue to fail.

Several tests are still ending up with the following error from the API:
"Subnetwork 'dataproc-cluster' does not support Private Google Access which is required for Dataproc clusters when 'internal_ip_only' is set to 'true'. Enable Private Google Access on subnetwork 'dataproc-cluster' or set 'internal_ip_only' to 'false'.",

Copy link

@Harwayne, this PR is waiting for action from you. If no action is taken, this PR will be closed in 28 days.

Please address any comments or change requests, or re-request review from a core reviewer if no action is required.

Image showing the re-request review button

This notification can be disabled with the disable-automatic-closure label.

Copy link

@Harwayne, this PR is waiting for action from you. If no action is taken, this PR will be closed in 14 days.

Please address any comments or change requests, or re-request review from a core reviewer if no action is required.

Image showing the re-request review button

This notification can be disabled with the disable-automatic-closure label.

Copy link

@Harwayne, this PR is waiting for action from you. If no action is taken, this PR will be closed in 2 weekdays.

Please address any comments or change requests, or re-request review from a core reviewer if no action is required.

Image showing the re-request review button

This notification can be disabled with the disable-automatic-closure label.

Copy link

@Harwayne, this PR is being closed due to inactivity.

@github-actions github-actions bot closed this Nov 26, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
awaiting-approval Pull requests that need reviewer's approval to run presubmit tests service/dataproc
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Dataproc Cluster unable to create with internal_ip_only = false
3 participants